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ABSTRACT 

The SAT I: Reasoning Test was introduced in March 
1993 for the national testing program of academic preparation and 
ability of college applicants, including students with disabilities. 
A survey was administered to 1,001 students with disabilities 
participating in a field trial of the SAT I prototype test. Students' 
disabilities were in the areas of learning, hearing, physical, 
visual, and psychological, and the test formats used were regular 
type, large type, cassette tape, braille, and reader's script. The 
survey covered: accommodations provided in school, test preparation, 
perception of adequacy of timing, and calculator accessibility and 
use. Results indicated that: (1) the most common school accommodac ion 
given for classroom tests was extended time, followed by testing in a 
separate room and use of a reader; (2) 57 percent of students 
received the test preparation leaflet and of those, 59 percent found 
it helpful; (3) most students felt that they did not need more time 
on either the verbal section or the math section of the test and 
approximately 90 percent of students completed the sections; (4) 76 
percent of students ised a calculator; and (5) 33 percent of students 
found the calculator to be useful all of the time, and 59 percent 
found it useful some of the time. (JDD) 
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College* have used ecoree on the SAT to determine the academic 

preparation and ability of applicants since the test was first 
administered in 1926. The skills *nd abilities of all students, 
both those without disabilities and those with disabilities, who 
are applying for admission to colleges can be meacured using this 
"common yardstick „ M This past March, a new SAT, the SAT I: 
Reasoning Test (SAT I) , was introduced for the national testing 
program as well as tor students with disabilities* The purpose of 
this paper is to summarize the results of a survey of the reactions 
of students with disabilities to the SAT I. 

Over the past several years a number of field trials have been 
carried out to investigate various technical and psychometric 
qualities of the changes to the SAT* A field trial conducted in 
December 1992 focused on the SAT I taken by students with 
disabilities. The purpose of this field trial was twofold: (1) to 
obtain information about the level of performance and amount of 
time used by students with different disabilities and (2) to 
solicit feedback from students, teachers, and counselors about the 
changes in the test, testing accommodations, and test format. 

The design of the field trial and analysis of the timing data 
are discussed in the paper by Wright and Wendler (1994) „ This 
paper provides results of the survey administered to students 
participating in the field trial. 
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SURVEY DESIGN ANT* SAMPLE 
Famdback Survmy 
The Student Feedback Survey was completed following the 
administration of the SAT I prototype test. Students were 
requested to complete the survey within two days after testing, in 
order to insure that the testing experience was fresh. Because of 
the timing required for some formats of the test, not all students 
could be expected to complete the survey on the same day as 
testing. 

The survey contained two sections. The first section asked 
questions about the testing situation and the student's disability. 
Four general areas were covered: (1) accommodations provided in 
school, (2) test preparation, (3) perception of adequacy of timing, 
and (4) calculator accessibility and use. The second section asked 
questions related to the specific format of the test a student 
took. Included were questions on reactions to new question types, 
adequacy of equipment, and reactions to answer sheets. Analyses of 
responses from the second section are not yet completed; hence, 
this paper will only address questions frc - section one. 
Sample 

While responding to the survey was voluntary, over 85% of the 
students participating in the field trial completed it. Responses 
were obtained from 1,001 students from 101 schools nation-wide. 
Results from one school were returned too late to be included in 
the timing analysis, but were included in the survey analysis. 

Two samples were used for analysis purposes. The first sample 
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contained all 1,001 students who responded to the survey. However, 
®0 in order to obtain some information about students, such as format 
of test used, it was necessary to match students with their testing 
data. The resulting sample after matching contained 931 students. 
When possible, the complete sample was used in the analysis of the 
survey questions. Table 1 presents the sample sizes for the 
unmatched and matched samples for total group and for the sample 
grouped by disability group. 
Disability Groups 

Students were asked if they had a disability in five areas: 
learning, hearing, physical, visual, and psychological. Students 
were considered as belonging to a particular disability group if 
they indicated on the survey that they had a particular disability. 
Many students indicated they had more than one type of disability 
and were counted as being in more than one disability group. Thus, 
analyses run by disability group include students who had indicated 
that they had more than one type of disability as well as those who 
indicated they had only one disability. 



RESULTS 

Sample Description 

Table 1 provides information on the unmatched and matched 
samples by total group, disability group, and gender (matched 
sample only) . Approximately 7% of the students responding to the 
survey were lost as a result of matching, although uhe loss 
appeared evenly shared among the various disability groups. The 
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learning disability group contained the largest number of students, 
while the psychologically disabled group contained the fewest. 
There were far more males (67%) than females (33%) involved in the 
field trial* Hales dominated every disability group with the 
exception of hearing and psychological disabilities, both of which 
contained a higher proportion of females than other groups* 

While most of the students had taken the PSAT/NMSQT (66%) , 
fewer had previously taken the SAT (27%). The SAT Verbal and Math 
scores for total group and by disability group (see Table 1) were 
somewhat lower than those reported in other studies (Ragosta & 
Wendler, 1992) • This might indicate the inexperience of these 
students with the SAT, low level of motivation to do well on 
experimentally -administered tests, selection bias at the schools, 
or impact of the timing constraints, testing conditions, or test 
changes . 

Host students (69%) opted for the regular- type test format, 
followed by the cassette version of the test (13%) (see Table 2) . 
As would be expected, type of test format used appeared to be 
related to disability. For example, the great majority of students 
with hearing (91%) and psychological (90%) disabilities took the 
regular- type test. Students with visual disabilities, however, 
took a wider range of formats, including regular-type (68%) , large- 
type (15%), cassette tape (12%), braille (2%), and script (2%). 

The section timing used in the field trial had been designed 
to facilitate group testing. It appears that most studr cs (87%) 
were tested in a group rather than individually (13%) (see Table 

6 
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Students were asked a series of questions about the type of 
aa mmodations they generally receive at school* f.able 3 displays 
the results of these questions. 

Overall, most students (46%) attended school in a regular 
classroom containing nondisabled students . a high proportion of 
students (36%) attended a special school for students with their 
disability. While this pattern held true for the learning, 
physical, and visual disabilities groups, it was not true for the 
hearing and psychologically disabled groups* in both of these 
cases, moat students indicated they attended a special school for 
students with their disability. 

The most common accommodation given for classroom tests was 
extended time (57%) . Testing in a separate room (23%) was the next 
most frequent accommodation, followed by the use of a i ader (20%) . 
Other accommodations, such as different tests, special test 
formats, and special equipment were used less frequently. 

Most students (84%) indicated the use of a regular-type book 
when reading. However, large-type books (6%) and books on tape 
(10%) were also used frequently by students. This was especially 
true for those students with visual disabilities. 
Test Preparation 

Responses to questions related to test preparation information 
distributed prior to the field trial are provided in Table 5. 
While the majority of students (57%) indicated they had received 
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helpful and 54% felt additional test preparation information would 
have been helpful. 
Section Timing 

Student perception of adequacy of section timing ie summarized 
in Table 6. Overall, most students felt that they did not need 
more time on either the Verbal sections (72%) or the Hath sections 
(72%) of the test. This number was somewhat lower for students 
with hearing disabilities, where only 65% of the students felt 
there had been adequate time on the Verbal sections and 63% felt 
the time was adequate for the Math sections. 

Students indicated overwhelmingly that they had completed the 
verbal sections: Verbal 1, 93% completion; Verbal 2, 92% 
completion; and Verbal 3, 91% completion. The same was *:rue for 
Hath: Hath 1, 91% completion; Math 2, 87% completion; and Math 3, 
90% completion* Patterns were generally consistent across all 
disabilities groups. 
Calculator Use 

A number of questions were related to calculator use and 
accessibility. Responses to these questions are summarized in 
Table 7. In general, students (76%) indicated that they used a 
calculator on the test. This number was the same over all 
disability groups, except for the hearing disability group where 
only 60% of the students indicated they used a calculator. Of 
those students using calculators, most students (63%) brought their 
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;or to the test (rather than having one supplied by the 



Again, this number was lover for the hearing disability 



group , where most students (52%) indicated they had not brought 
their own calculator. 

Of those students using calculators , the majority {62%) used 
a four-function calculator, 35% used a scientific c zulator, 8% 
used a graphics calculator, and 16% used a business calculator. 
The proportions of students by disability group using each type of 
calculator are fairly consistent. 

Most students (59%) found the calculator to be useful some of 
the time, while others (33%) found it useful all of the time. A 
few (7%) found it not to be helpful. About 45% of students used 
the calculator on only a few questions, 22% indicated they used it 
on about 1/3 of the questions, 19% used it on about 1/2 of the 
questions, and 14% on most SAT-math questions. 

Most students (93%) indicated they do not have a calculator 
with special adaptations. However, students with physical (19%) 
and visual disabilities (16%) are more likely to have special 
adaptations compared to the other disability groups. 

Overall, most students (71%) have calculator use included as 
part of their Individual Education Plan. Many students (61%) 
indicated they used the calculator on classroom tests and more than 
three-quarters (78%) said they used the calculator on homework. 
Finally, most students (81%) indicated that they had been taught 
how to use a calculator. 




The introduction of the SAT I provided the opportunity to 
revisit the way the SAT has traditionally been administered to 
students with disabilities. This paper summarizes results of a 
survey administered to students with disabilities participating in 
a field trial of the SAT I* 

What did the students who participated in the field trial say 
about the SAT I? 

First, it is reassuring to note that the accommodations 
offered by the SAT Program for Students with Disabilities parallel 
those used by students when talcing classroom tests. Most students 
testing through the SAT Program for Students with Disabilities use 
extended testing time and request individual administrations of the 
test (through Plan A) • A multitude of accommodations are requested 
— and provided — through this program • 

Second , students' perceptions of timing were consistent with 
actual timing. That is, students believed they had adequate time 
to complete the test and indicated that, in general, they had 
completed each section of the test. Timing data found in Wright 
and Wendler (1994) shoved that overall, students did complete the 
various sections of the tests. Although the field trial imposed 
section timing, a constraint not found in the real administration 
of the SAT, students still indicated they had adequate time. The 
issue of test timing, and in particular section timing, will 
continue to be explored as the SAT I becomes operational. 
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reinforce the need to provide students with adequate information 
prior to being given the test. One additional benefit of the field 
trial: The creation of the prototype SAT I in various formats for 
the field trial subsequently allows for practice forms of the test 
to be distributed to students prior to testing H for real. 11 

Finally, the issue of calculator use and accessibility is 
important in that the SAT I allows students to use a calculator on 
the Math sections of the test. Other field trials have collected 
data regarding accessibility of calculators across various groups 
of students. The field trial for students with disabilities used 
similar questions as those used with previous field trials for non- 
disabled students. Knowing that three-quarters of the students 
used a calculator on the test, and the majority of students used 
their own calculator, points to accessibility of calculators for 
groups of disabled students. The great majority of students used 
a four-function or scientific calculator, paralleling what has been 
found with nondisabled students. 

This paper provided preliminary analyses of the survey used 
with students participating in the December 1992 SAT I field trial. 
Additional analyses are warranted and are continuing. Responses to 
survey questions as they relate to the format of the test taken 
(regular- type, large-type, braille, cassette tape, or script) are 
important. In addition, data relevant to timing and testing 
accommodations will be routinely collected and analyzed as the . »w 



u 



o 

ERIC 




11 



REFERENCES 



Ragoata, M. , & Wendler, C. (1992). eligibility iaauaa and 
comparable time limits for disabled and nondieabled SAT 
examlneaa. (Report No. 92-5) . New York: Collage Entrance 
Examination Board. 

Wright, H. , & Wendler, C. (1994, April). Eatahllahlna timing 
llmita for the new SAT for afcudanta with dlaahllifciea. Paper 
presented at the annual meeting of the National Council on 
Measurement in Education, New Orleans. 



fx 

3 



i 




12 



Table 1 

Sample Sizes and Mean SAT Scores 



Group 


Unmatched 1 

%F • Mini 

Sample 


Total 3 


Female 


Male 


SAT 
Verbal 


SAT 
Math 


All Students 


n 

1,001 


n 

931 


n 

306 


n 

622 


Mean 

315 
(10.12) 


Mean 

347 
(9.80) 


Disability Group? 
Learning 


680 


626 


182 


442 


313 
(8.89) 


346 
(9.14) 


Hearing 


128 


121 


52 


68 


257 
(7.24) 


303 
(6.75) 


Physical 


124 


111 


39 


72 


317 
(9.82) 


349 
(10.41) 


Visual 


103 


98 


37 


61 


330 
(10.58) 


352 
(10.59) 


Psychological 


64 


61 


27 


34 


345 
(10.63) 


358 
(9.03) 



'Sample consists of all students who responded to survey. 
'Sample consists of students who responded to survey and were matched to 
testing data. 

'Total includes some students who did not indicate gender. 
4 Students who indicated multiple disabilities were inclvded in more than 
one group. 

Note, Numbers in parentheses are standard deviations. 
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Regular-Type Large-Type Cassette Braille Script 
Group Book Only Book Only w/ Any Book Book Only v/ Any Book 



All Students 


69 


8 


13 


<1 


2 


By Disability: 
Learning 


64 


8 


17 




3 


Hearing 


91 


5 


5 






Physical 


73 


6 


17 




4 


Visual 


68 


15 


12 


2 


2 


Psychological 


90 




10 







Sample consists of students who responded to survey and were matched to 
testing data. About 8% of students were missing valid test form 
codes. 
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Group 


Individual 


Group 


All Students 


13 


87 


By Disability: 
Learning 


12 


88 


Hearing 


26 


74 


Physical 


13 


87 


Visual 


13 


87 


Psychological 


8 


f)2 



! Sample consists of all students who responded to survey. 
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Table 4 

ercent of Students 1 Using Specific Accommodations 



Survey Question 



Dt ■ability Group 



All Learning Hearing Physical visual Psychological 



Which best describes the school/ 

class you are attending? 
Special school 36 35 

Special class 19 22 

Regular class 46 43 



60 
14 
26 



35 
23 
42 



32 
18 
49 



44 
18 

22 



Which accommodations have you 
received during class tests? 



Extra time 


57 


69 


38 


64 


63 


50 


Separate room 


23 


29 


16 


32 


34 


23 


Peader 


20 


26 


13 


16 


24 


17 


Different test 


8 


9 


9 


8 


10 


11 


Special equipment 


7 


8 


7 


10 


17 


3 


cassette test 


5 


13 


1 


4 


8 


2 


Recorder/ scribe 


4 


5 


3 


3 


8 


3 


Large-type test 


4 


3 


5 


6 


15 


5 


Braille test 


<1 


0 


0 


0 


2 


0 



Which do you use when reading 
a book? 

Pegular-type 84 87 

Large-type 6 5 

Braille 1 1 

cassette tape 10 9 

A reader 7 6 



78 
9 
2 
6 

13 



83 
10 

2 
10 

9 



77 
19 

2 
16 

8 



89 
14 

8 
13 

9 



'Sample consists of all students who responded to survey. 
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Table 5 

of Students 1 Responding to Test Preparation Questions 



Survey Question 



Disability Croup 



All Learning Rearing Physical visual Psychological 



Did you receive a test 
preparation leaflet? 
Yob 57 
No 43 



56 
44 



62 
38 



60 
40 



52 
48 



52 
48 



Was it helpful? 
Yob 
No 



59 
41 



57 
43 



65 
35 



63 
37 



52 
48 



51 
49 



Would additional test 
preparation been helpful? 
Yob 54 
No 46 



54 
46 



48 

52 



55 
45 



61 
39 



55 
45 



'Sample consists of all students who responded to survey. 
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Table 6 

ent of Students' Responding to Test Timing Questions 



Survey Question 



Dleahlllfcv Group 



All Learning Hearing Physical Visual Psychological 



Did you need more tine 
on the yerbal sections? 
Yes 28 

No 72 



29 
71 



35 
65 



30 
70 



30 
70 



22 
78 



Did you complete. . . 
the first verbal section? 
Yes 93 
Wo 7 



92 
8 



93 
7 



93 
7 



91 
9 



90 
10 



the second verbal section? 

Yes 92 92 

No 8 8 



91 
9 



92 
8 



92 
8 



91 
9 



the third verbal section? 

Yes 91 91 

No 9 9 



93 
7 



91 
9 



92 
8 



89 
11 



Did you need more time 
on the math sections? 

Vac 



on 
Yes 
No 



28 
72 



26 
74 



37 
63 



30 
70 



33 
67 



26 
74 



Did you complete . . . 
the first math section? 
Yes 91 
No 9 



91 
9 



91 
9 



89 
11 



88 
12 



83 
17 



the second math section? 

Yes 87 87 

No 13 13 



85 
15 



84 
16 



84 
16 



86 
14 



the third math section? 

Yes 90 92 

No 10 8 



88 
12 



88 

12 



91 
9 



84 
16 



'Sample consists of all students who responded to survey. 
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Table 7 



Percent of Students 1 Responding to Calculator Questions 



Disability Qrouo 



survey Question All Learning Hearing Physical Visual Psychological 

Did you use a calculator 
on the test? 

Yes 76 79 60 75 78 72 

No 24 21 40 25 22 28 



Did you bring your own 

calculator to the test? 
yes 63 65 48 62 51 60 

No 37 35 52 38 42 40 



What type of calculator did 
you use? 

Four-/ unction 62 59 53 64 67 85 

Scientific 35 37 43 36 32 15 

Graphics 8 1 0 0 0 0 

Business 16 2 3 0 1 0 



How helpful was the calculator? 
Not helpful 7 7 

Helpful some time 59 60 
Helpful fflost time 33 34 



5 
56 
39 



10 
54 
35 



13 
49 
31 



6 
68 
12 



calculator? 
On a fetr questions 
On 1/3 questions 
On 1/2 questions 
On most questions 



special adaptations? 
Yes 

NO 



the 












45 


41 


48 


40 


42 


40 


22 


24 


23 


13 


18 


24 


19 


19 


16 


28 


25 


24 


14 


16 


13 


19 


15 


11 


lcluda 












7 


5 


10 


19 


16 


6 


93 


95 


90 


81 


84 


94 



20 




181 



19 



Of Table 7 continued 

cent of Students' Responding to Calculator Questions 



Survey Question 



Disability Croup 



All Learning Hearing Physical Visual Psychological 



Does your IEP include permission 

to use a calculator? 
Yea 71 71 

No 29 29 



63 
36 



71 
29 



71 
29 



75 
25 



Do you use a calculator 
on classroom tests? 
yes 61 
Wo 39 



67 
33 



58 
42 



61 

39 



61 
39 



35 
65 



Do you use a calculator 
for homework? 
yes 78 

No 22 



81 
19 



84 
16 



75 
25 



76 
24 



65 
35 



Have you been taught how 
to use a calculator? 
yes 81 
No 19 



79 
31 



82 
18 



84 
16 



82 
18 



77 
23 



'Sample consists of all students who responded to survey. 
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